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Abstract It is traditionally believed that the macroscopic randomness has nothing to do with the 
micro-level uncertainty. Besides, the sensitive dependence on initial condition (SDIC) of Lorenz chaos 
has never been considered together with the so-called continuum- assumption of fluid (on which Lorenz 
equations are based), from physical and statistic viewpoints. A very fine numerical technique [6] with 
negligible truncation and round-off errors, called here the "clean numerical simulation" (CNS), is 
applied to investigate the propagation of the micro-level unavoidable uncertain fluctuation (caused 
by the continuum-assumption of fluid) of initial conditions for Lorenz equation with chaotic solutions. 
Our statistic analysis based on CNS computation of 10, 000 samples shows that, due to the SDIC, the 
uncertainty of the micro-level statistic fluctuation of initial conditions transfers into the macroscopic 
randomness of chaos. This suggests that chaos might be a bridge from micro-level uncertainty to 
macroscopic randomness, and thus would be an origin of macroscopic randomness. We reveal in this 
article that, due to the SDIC of chaos and the inherent uncertainty of initial data, accurate long- 
term prediction of chaotic solution is not only impossible in mathematics but also has no physical 
meanings. This might provide us a new, different viewpoint to deepen and enrich our understandings 
about the SDIC of chaos. 
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1 Introduction: A paradox arising from Lorenz chaos 

Nowadays, it is a common belief pi l3l[5l [1211131 [16] of scientific society that some "deterministic" 
dynamic systems have chaotic behaviors: their solutions are exponentially sensitive to initial condi- 
tions so that accurate long-term prediction of chaotic solution is impossible. Here, the deterministic 
means that the evolution of solutions is fully determined by initial conditions without random or 
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uncertain elements involved. Such kind of behaviors is called "deterministic chaos" [5], because "the 
deterministic nature of these systems does not make them predictable" [16] . 

Such kind of non-periodic solutions was first pointed out by Poincare [9j in 1880s for the famous 
three-body problem. In 1962 Saltzman [H] found "oscillatory, overstable cellular motions" and "con- 
sequently an alternating value of the heat transport about a time-mean value" for a free convection 
flow with very large Rayleigh number. It is a pity that Saltzman pjj paid main attentions on the 
stable solutions for Rayleigh number smaller than 10. Fortunately, this "oscillatory, overstable" non- 
periodic solutions of the free convection flow was further studied in details by Lorenz [7] in 1963 for 
the weather prediction, governed by the so-called Lorenz equation 



where a, R and b are physical parameters, the dot denotes the differentiation with respect to the 
time. Although the Lorenz equation is much simpler than those used by Saltzman [TT], its solution 
also becomes "oscillatory, overstable" for large Rayleigh number. Especially, using a digit computer 
and data in 6-digit precision, Lorenz |7] found that small changes in initial conditions leaded to great 
difference in long-term prediction, called today the "butterfly effect" . Based on the "butterfly effect" , 
Lorenz [7] made a correct conclusion that long-term weather prediction is impossible, although the 
Lorenz equation is only a very simple approximation model of the exact Navier-Stokes equations. 

All numerical methods have the so-called truncation and round-off error, more or less. Due to the 
so-called "butterfly effect" , all traditional numerical simulations of chaos are mixed with such kind of 
"numerical noise". Unfortunately, as pointed out by Lorenz [8] in 2006, different traditional numerical 
schemes may lead to not only the uncertainty in prediction but also fundamentally different regimes 
of the solution. Thus, the traditional numerical simulations of chaos are not "clean" so that some of 
our understandings about chaos based on these impure numerical results might be questionable. 



In order to gain reliable chaotic solutions in a long enough time interval, Liao |i6j developed a 
flne numerical technique with extremely high precision, called here the "clean numerical simulation" 
(CNS). Using the computer algebra system Mathematica with the 400th-order Taylor expansion for 
continuous functions and data in accuracy of 800-digit precision, Liao |6] gained, for the first time, 
"clean" numerical results of chaotic solution of Lorenz equation (in a special case cr = 10, i? = 28, b = 
—8/3) in a long time interval < t < 1000 Lorenz time unit (LTU) with negligible truncation and 
round-off error. It was found by Liao [6] that, to gain a reliable "clean" chaotic solution of Lorenz 
equation in < t < Tc, the initial conditions must be at least in the accuracy of 10"^^'=/^. Thus, 
when Tc = 1000 LTU, the initial condition must be in the accuracy of 400-digit precision at least. 
Currently, Liao's "clean" chaotic solution P of Lorenz equation is confirmed by Wang et al jT5] . 
who used parallel computation with the multiple precision (MP) library: they gained reliable chaotic 
solution up to 2500 LTU by means of the lOOOth-order Taylor expansion and data in 2100-digit 
precision, and their result agrees well with Liao's one |6j in < t < 1000 LTU. Their excellent work 
verified the validity of the "clean numerical simulation" (CNS) proposed by Liao |6]. These reliable 
"clean" chaotic solutions and especially the CNS provide us a powerful tool to investigate the essence 
of SDIC and the "butterfiy effect" from the physical and statistic points of view, as shown below. 

Since Lorenz [7j introduced the concept of SDIC of chaos, its meanings has been discussed and 
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investigated in many articles and books, mostly from the viewpoints of mathematics, logic and 
philosophy, but hardly from physical viewpoints. This might be mainly because most models of 
chaos are too simple to accurately describe the complicated physical phenomena. So, to deepen our 
understandings about the SDIC of chaos, it is valuable to study it from the physical viewpoints. 

Lorenz equation [7] was originally derived from the Navier-Stokes (N-S) equation describing phe- 
nomena of fluid motions. The N-S equations are based on such an assumption that the fluid is a 
continuum, which is infinitely divisible and not composed of particles such as atoms and molecules. 
Let us consider the uniform laminar flow of air with the velocity 1 (m/s) at the temperature T = °C 
and the standard pressure. In this case, there are about 2.687 x 10^^ molecules in a cube of fluid. This 
is a hugh number so that the continuum-assumption of fluid is mostly satisfied in practice. Assume 
that all molecules of a cube of fluid have the same velocity, except one which has a tiny velocity fluc- 
tuation 10""^ m/s. Then, the averaged velocity fluctuation of a cube of fluid reads 3.722 x 10~'^° m/s. 
Such micro-level velocity fluctuation of fluid should be neglected under the continuum-assumption. 
In other words, in the frame of the continuum-assumption, it has no physical meanings to consider 
the observable influence of such a tiny velocity fluctuation, from physical point of view! 

However, Liao's CNS computation [B] in the accuracy of 800-digit precision indicates that, mathe- 
matically, to gain reliable chaotic solution in < T < 1000 LTU, the fluctuation of initial conditions 
must be less than 400-digit precision at least. Note that the number 10~^°° is much smaller than 
3.722 X 10~^° that is a minimum of the averaged velocity fluctuation of fluid! Thus, as mentioned 
above, from physical point of view, such a tiny velocity fluctuation (in the level of 10"^"°) has no 
physical meanings at all under the continuum-assumption that is a base of Lorenz equation! There- 
fore, a paradox arises: according to the continuum-assumption, the tiny velocity fluctuation in the 
level of 10"^*^ should have no observable influence on the chaotic solution of Lorenz equation; on the 
other hand, the SDIC and "butterfly effect" indicate that the influence of a tiny velocity fluctuation 
even in the level of 10"'*°° must be considered! This is certainly a paradox in logic! 

In history, many paradoxes first revealed the restrictions of some well-established theories and 
then greatly promoted their developments. What is the essence of this paradox from the viewpoint 
of physics? What can we learn from it? 

2 From micro-level uncertainty to macroscopic randomness 

Without loss of generality, let us consider the Lorenz equation with chaotic solution in case of 
R = 28, b = —8/3 and a = 10. Assume that the observable values of initial condition 

= -79/5, yo = -437/25, zq = 891/25 

are given exactly. However, due to the continuum- assumption of fluid, the initial conditions involve 
the uncertainty: the statistic fluctuations of velocity and temperature are inherent and unavoidable 
in essence, although their absolute values are often much smaller than those of the observable values 
of initial condition. According to the central limit theorem in probability theory, we assume that 
the fluctuations of velocity and temperature are in the normal distribution with zero mean and a 
micro-level deviation do, such as (Jq = 10~^° used in this article. Thus, the entire initial conditions 
x{0) = Xq + Xq, y{0) = yo + yo and z{0) = Zq + zq involve random, where Xq, yo, zq are random variables 
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in the normal distribution with zero mean and deviation ctq, i.e. 

{xo) = {yo) = {zo) = 0, (xl) = {yl) = (5^) = (To. 

For each random initial condition, the corresponding "clean" chaotic solution is gained by means of 
the CNS [6] with the 60-order Taylor expansion and data in the accuracy of 120-digit precision. For 
details, please refer to Liao [6]. According to Liao's work [6], both of the truncation and round-off 
error are negligible in < t < 180 LTU. Thus, the numerical results are "clean" at least in < t < 150 
LTU, i.e. without any observable influence by numerical noise. Note that, although the standard 
deviation ctq = 10^'^° of the uncertain terms Xq, yo, Zq of initial condition is much smaller than the 
observable values Xq, yo, Zq, it is hugh compared to 10~^^°: the truncation and round-off errors of the 
numerical simulations gained by the 60th-order Taylor formula and the data in accuracy of 120-digit 
precision are much smaller than the deviation 10~^^ and thus are negligible in < t < 180 LTU. In 
this way, we can accurately investigate, for the first time, the influence of the micro-level statistic 
fluctuation of initial conditions to chaotic solutions, and especially the propagation of uncertainty 
from the micro-level statistic fluctuation of initial conditions to macroscopic randomness of chaos. 

Let {x(t)) , {yit)) , {z{t)) and ax{t),ay{t),az{t) denote the sample mean and unbiased estimate of 
standard deviation of x{t),y{t), z{t), respectively, where N = 10^ is the number of samples gained 
by the CNS. Define the so-called uncertainty intensity 
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Figure 1: The uncertainty intensity e(t) in case of the fluctuation of initial conditions in the normal 
distribution with zero mean and micro-level deviation ao = 10"'^°. 



It is found that there exists such a time interval t G [0, T^] with 75, in which e{t) is so small 
that one can accurately predict the behavior of the dynamic system, but beyond which the uncertainty 
intensity increases greatly, as shown in Fig. [TJ Thus, using the result at any a point t G (0, Td) as 
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the initial condition and setting t = —t, we can gain the given observable vahies xo,yo,zo of initial 
conditions in a high-level of accuracy, meaning that the dynamic system looks like deterministic 
in < t < Td and that the influence of the uncertain statistic fluctuation of initial condition is 
negligible. But, beyond it, the solutions become rather sensitive to the uncertain statistic fluctuation 
(in the level of 10~^°) of initial condition and look like random, say, the micro-level uncertain statistic 
fluctuation in initial condition transfers into the observable macroscopic randomness. So, is an 
important time scale for Lorenz chaos. 

As shown in Fig. [H there exists the time with Tg ^ 120 LTU, beyond which the cumulative 
distribution functions (CDF) of x{t),y(t), z(t) and so on are approximately stationary, i.e. almost 
independent of the time. Besides, these CDFs are independent of the observable values Xq^Uq^zq of 
initial conditions, meaning that all observable information of initial conditions are lost completely. 
In other words, when t > Td, the asymmetry of time seems to break down so that the time has a one- 
way direction, i.e. the arrow of time. It suggests that, statistically, the chaotic Lorenz system might 
have two completely different dynamic behaviors before and after T^. it looks like "deterministic" 
without time's arrow when t < T^, but thereafter rapidly becomes random with the arrow of time. 
This strongly suggests that chaos might be a bridge from the micro-level uncertainty to macroscopic 
randomness, and thus might be an origin of macroscopic randomness and the time's arrow. This 
provides us a new, different viewpoint to enrich and deepen our understandings about the SDIC of 
chaos. 

When Td < t < Tg, the CDFs of x{t),y{t), z{t), their sample means and unbiased estimates of 
standard deviation are time-dependent, and evolve to the approximately stationary ones for t > Tg. 
This process is called the transition from the deterministic to randomness of chaos. 

Write x' = x— < x >,y' = y— < y > and z' = z— < z >. It is found that the CDFs of the 
fluctuations x',y',z' are time- dependent when t < Tg and become stationary when t > Tg. When 
t > Td, the CDF of x' is different from the normal distribution with the standard deviation < x'"^ >, 
so are the CDFs of y' and z', as shown in Fig. [2J It is also found that Td decreases exponentially 
with respect to ctq, the standard deviation of the tiny uncertain variables Xq, y^, zq of the initial 
conditions. Besides, the stationary CDFs of x',y',z' are independent of the CDFs of xo,yo,zo. In 
addition, more samples are needed to gain accurate mean of the high correlations of x', y', z', such as 
< x'z' >, < y'z' > and especially < x'z'z' >, < x'y'y' >, < y'y'z' >, < y'z'z' > and < x'y'z' >, since 
the higher correlations have the larger standard derivations: this shows the difficulty to propose an 
accurate model for the mean <x>,<y>,<z>hY means of these higher correlations. This also 
explains why it is so difficult to propose a satisfied turbulence model valid for all kinds of turbulent 
flows, since Lorenz equation is a simplified model from Navier-Stokes equations. Note that, one can 
directly obtain all of these correlations from the Lorenz equation, as long as the number of samples 
are large enough. In other words, no additional models for<x>,<?/>,<z> are needed. 

It is found that, given (Tq = 10^'^° in case of R = 28, b = —8/3 and cr = 10, we gain exactly the 
same figure as shown in Fig. [H even if we use more accurate numerical results obtained by means of 
the CNS with the 120-order Taylor expansion and data in the accuracy of 240-digit precision! Note 
that it has no physical meanings to use a micro-level deviation ctq of the initial conditions smaller 
than 10"'^'^, as pointed out in the section of introduction. Thus, for chaotic dynamic systems, the 
transfer from micro-level uncertainty to macroscopic randomness seems unavoidable. In addition, 
it is fund that, in case of 6 = —8/3, a = 10 and R < 23.54 so that solutions are not chaotic, the 



Figure 2: The CDF (solid line) of z' at t = 80 LTU and t = 150 LTU, compared with the corre- 
sponding normal distribution (dashed line) with the zero mean and the standard deviation < z'^ >. 

micro-level uncertainty never transfers into the macroscopic level. Therefore, the SDIC of chaos is 
the key to such kind of transfer. 

3 Conclusion and discussion 

In this article, the sensitive dependence on initial condition (SDIC) of Lorenz chaos is considered to- 
gether, for the first time, with the so-called continuum-assumption of fluid (on which Lorenz equations 
are based) from physical and statistic viewpoints. The so-called "clean numerical simulation" (CNS) 
proposed by Liao [6] is used to investigate the propagation of the micro-level unavoidable uncertain 
fluctuation (caused by the continuum-assumption of fluid) of initial conditions with chaotic solutions 
of Lorenz equation. Our statistic analysis based on the CNS computation of 10^ samples suggests 
that, due to the SDIC, the uncertainty of the micro-level statistic fluctuation of initial conditions 
transfers into the macroscopic randomness of chaos. This may deepen and enrich our understandings 
about the SDIC and chaos, from a different viewpoint of physics. 

The microscopic phenomena are essentially uncertain, although probability distributions are gov- 
erned by deterministic equations. However, it is traditionally believed that the micro-level uncertainty 
has no relationships with the macroscopic randomness. But, our statistic analysis strongly suggests 
that the micro-level uncertainty might be an origin of the macroscopic randomness, and chaos might 
be a bridge between them. Although the above conclusion is based on Lorenz equation, it has 
general meanings. First, we also investigated some other chaotic dynamic systems, and found the 
same transfer from micro-level uncertainty to macroscopic randomness for all of them. Secondly, as 
pointed out by Saltzman [TT], the solutions of a dynamic system consist of seven nonlinear differential 
equations for the free convention (which is a more accurate model than Lorenz equation) are "oscilla- 
tory, overstable" (i.e. chaotic) for large enough Rayleigh number. In fact, Saltzman [11] represented 
the solution of the original continuous differential equations as a sum of double-Fourier components, 
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and approximated the original problem by a set of nonlinear ordinary different equations with finite 
number of degree of freedom. Both of the Lorenz equation and the above mentioned system of seven 
equations are only special cases of it, corresponding to three and seven degree of freedom. Obviously, 
the larger the degree of freedom, the more accurate the model. It is found that, for large enough 
Rayleigh number, these dynamic systems given by Saltzman [TT] with degree of freedom not less 
than three are chaotic, so that the micro-level uncertainty transfers into macroscopic randomness for 
all of them. Theoretically speaking, as the number of degree of freedom tends to infinity, this system 
becomes the original continuous differential equations. Thus, our conclusion about the transfer from 
micro-level uncertainty to macroscopic randomness has general meanings, although it is based on the 
Lorenz equation. This is similar to the Lorenz's famous conclusion "long-term accurate prediction 
of weather is impossible" [7], which is based on the Lorenz equation, a very simple model of the N-S 
equation, but is correct and has been widely accepted by the scientific community. 

The similar transfer has been reported in some other fields. For example, as pointed out by 
Bai et al [1], the disorder of materials plays a fundamental role to the so-called sample-specific 
behavior of fracture, i.e. the macroscopic failure may be quite different, sample to sample, under 
the same macroscopic condition, because the differentiation due to meso-scopic disorder may be 
greatly amplified and lead to largely different macroscopic effects. Xia et al [T7j studied the failure of 
disordered materials by means of a stochastic slice sampling method with a nonlinear chain model, 
and found that "there is a sensitive zone in the vicinity of the boundary between the globally stable 
(GS) and evolution-induced catastrophic (EIC) regions in phase space, where a slight stochastic 
increment in damage can trigger a radical transition from GS to EIC". In other words, the meso- 
scopic uncertainty of disordered materials transfers into the macroscopic randomness of failure. As 
mentioned by He et al [4j, the nonlinearity and multi-scale might play a fundamental role in it. So, 
"(stochastic) fluctuations are important and must not be neglected" for the failure of disordered 
materials, as pointed out by Sahimi and Arbabi [TU]. Another example is the evolution of the 
universe: the micro-level uncertainty at Big Bang, the inherent uncertainty of position and velocity 
of stars, and the nonlinear property of gravity might be the origin of the macroscopic randomness 
of the universe. All of these support our conclusion: the transfer from micro-level uncertainty to 
macroscopic randomness might have meanings in general. 

Traditionally, it is believed that the SDIC of chaos is the origin of the so-called "butter-fiy effect" : 
long-term prediction is impossible due to the SDIC of chaos and the impossibility of getting exact 
initial data with precision of arbitrary degree. This traditional idea implies that the initial data itself 
are exact inherently but our human-being can not obtain the exact value. However, as pointed out in 
this article, this traditional thought might be wrong: due to the continuum-assumption of fluid, there 
exists the statistic fluctuation of the initial data of Lorenz equation, no matter whether we could 
precisely measure the initial data or not. It should be emphasized that such kind of uncertainty is 
inherent: it has nothing to do with our ability. In this article, it is revealed that, due to the SDIC and 
the inherent uncertainty of initial data, accurate long-term prediction of chaotic solution is not only 
impossible in mathematics but also has no physical meanings. This provides us a new explanation 
of the SDIC of chaos, from the physical and statistic points of view. 

The micro-level uncertainty and the physical variables x, ?/, z of Lorenz equation are at different 
scales: the absolute value of the former (at the level of 10~^°) is much smaller than that of the 
latter (at the level of 1). Unfortunately, the truncation and round-off errors (often at the level of 
10~^°) of most traditional numerical techniques for chaos are much larger than such kind of micro- 
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level uncertainty, so that the propagation of the micro-level uncertainty is completely lost in the 
numerical noises. The CNS [6] provides us a way to accurately investigate such kind of problems 
with multiple scales, since the numerical noises of the CNS are much smaller than the micro-level 
uncertainty. 

Lorenz equation is a simplified model based on the N-S equations describing flows of fluid. Note 
that nearly all models of turbulence are deterministic in essence: the micro-level uncertain statistic 
fluctuation of velocity caused by the continuum-assumption of fluid has been neglected completely. 
Note also that the uncertainty intensity (jl]) is rather similar to the deflnition of turbulence intensity. 
Since turbulence has a close relationship with chaos, it might be possible that the influence of the 
micro-level statistic fluctuation of velocity and temperature should be considered: we even should 
carefully check the theoretical foundation of turbulence and the direct numerical simulation (DNS), 
such as the continuum-assumption of fluid. Besides, our very fine numerical simulations and related 
analysis reported in this article suggest that the randomness of turbulence might come essentially 
from the micro-level uncertain statistic fluctuation of velocity and temperature: turbulence is such a 
kind of flow of fluid that it is so unstable that the micro-level uncertainty transfers into macroscopic 
randomness. 

Hopefully, this work stimulated by a paradox could provide us some new physical insights and 
mathematical ways to deepen and enrich our understanding about chaos and turbulence. 
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